Random weighting in LASSO regression
نویسندگان
چکیده
We establish statistical properties of random-weighting methods in LASSO regression under different regularization parameters ?n and suitable regularity conditions. The view concern repeated optimization a randomized objective function, motivated by the need for computationally efficient uncertainty quantification contemporary estimation settings. In context regression, we repeatedly assign analyst-drawn random weights to terms optimize obtain sample estimators. show that existing approaches have conditional model selection consistency asymptotic normality at growth rates as n??. propose an extension available resulting samples attain sparse growing-dimension setting. illustrate proposed methodology using synthetic benchmark data sets, discuss relationship results approximate nonparametric Bayesian analysis perturbation bootstrap methods.
منابع مشابه
Random Lasso.
We propose a computationally intensive method, the random lasso method, for variable selection in linear models. The method consists of two major steps. In step 1, the lasso method is applied to many bootstrap samples, each using a set of randomly selected covariates. A measure of importance is yielded from this step for each covariate. In step 2, a similar procedure to the first step is implem...
متن کاملHomework 2: Lasso Regression
Instructions: Your answers to the questions below, including plots and mathematical work, should be submitted as a single PDF file. It’s preferred that you write your answers using software that typesets mathematics (e.g. LATEX, LYX, or MathJax via iPython), though scanning handwritten work is fine as well. You may find the minted package convenient for including source code in your LATEX docum...
متن کاملLazy lasso for local regression
Locally weighted regression is a technique that predicts the response for new data items from their neighbors in the training data set, where closer data items are assigned higher weights in the prediction. However, the original method may suffer from overfitting and fail to select the relevant variables. In this paper we propose combining a regularization approach with locally weighted regress...
متن کاملAdaptive Lasso and group-Lasso for functional Poisson regression
High dimensional Poisson regression has become a standard framework for the analysis of massive counts datasets. In this work we estimate the intensity function of the Poisson regression model by using a dictionary approach, which generalizes the classical basis approach, combined with a Lasso or a group-Lasso procedure. Selection depends on penalty weights that need to be calibrated. Standard ...
متن کاملCoordinate Descent Algorithms for Lasso Penalized Regression
Imposition of a lasso penalty shrinks parameter estimates toward zero and performs continuous model selection. Lasso penalized regression is capable of handling linear regression problems where the number of predictors far exceeds the number of cases. This paper tests two exceptionally fast algorithms for estimating regression coefficients with a lasso penalty. The previously known ℓ2 algorithm...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2022
ISSN: ['1935-7524']
DOI: https://doi.org/10.1214/22-ejs2020